Near Optimal Bayesian Active Learning for Decision Making
نویسندگان
چکیده
How should we gather information to make effective decisions? We address Bayesian active learning and experimental design problems, where we sequentially select tests to reduce uncertainty about a set of hypotheses. Instead ofminimizing uncertainty per se, we consider a set of overlapping decision regions of these hypotheses. Our goal is to drive uncertainty into a single decision region as quickly as possible. We identify necessary and sufficient conditions for correctly identifying a decision region that contains all hypotheses consistent with observations. We develop a novel Hyperedge Cutting (HEC) algorithm for this problem, and prove that is competitive with the intractable optimal policy. Our efficient implementation of the algorithm relies on computing subsets of the complete homogeneous symmetric polynomials. Finally, we demonstrate its effectiveness on two practical applications: approximate comparison-based learning and active localization using a robotmanipulator.
منابع مشابه
Efficient Methods for Near-Optimal Sequential Decision Making under Uncertainty
This chapter discusses decision making under uncertainty. More specifically, it offers an overview of efficient Bayesian and distribution-free algorithms for making near-optimal sequential decisions under uncertainty about the environment. Due to the uncertainty, such algorithms must not only learn from their interaction with the environment but also perform as well as possible while learning i...
متن کاملAn Introduction to Inference and Learning in Bayesian Networks
Bayesian networks (BNs) are modern tools for modeling phenomena in dynamic and static systems and are used in different subjects such as disease diagnosis, weather forecasting, decision making and clustering. A BN is a graphical-probabilistic model which represents causal relations among random variables and consists of a directed acyclic graph and a set of conditional probabilities. Structure...
متن کاملElderly Daily Activity-Based Mood Quality Estimation Using Decision-Making Methods and Smart Facilities (Smart Home, Smart Wristband, and Smartphone)
Due to the growth of the aging phenomenon, the use of intelligent systems technology to monitor daily activities, which leads to a reduction in the costs for health care of the elderly, has received much attention. Considering that each person's daily activities are related to his/her moods, thus, the relationship can be modeled using intelligent decision-making algorithms such as machine learn...
متن کاملStructure Learning in Human Sequential Decision-Making
Studies of sequential decision-making in humans frequently find suboptimal performance relative to an ideal actor that has perfect knowledge of the model of how rewards and events are generated in the environment. Rather than being suboptimal, we argue that the learning problem humans face is more complex, in that it also involves learning the structure of reward generation in the environment. ...
متن کاملSOLID robot perception
In a series of papers, we have formalized an active Bayesian perception approach for robotics based on recent progress in understanding animal perception. A central aspect of this active perception approach is the inference of ‘where’ and ‘what’ objects are in the environment under uncertainty, termed Simultaneous Object Localization and IDentification (SOLID). Here we describe some of the deta...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014